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The Effect of Ihterspersihg 
Questions in Text: Evidence fb 
**Siicing the Task" 

The controversy over the effect of questions on learning 
from text, whiie temporarily put to rest^ remains a dormant 
and still unsettled issue in the professional literature, 
ftithough research on the effects of interspersing questions in 
text is abundant^ few^ if ahy^ classrcSbm generalizations can be 
made from this area of experimentation. Ghe reason for this 
continuing uncertainty can be attributed to the methods and 
procedures used to collect the data. In most instances, the 
studies were conducted under cohditibhs which were not ecoiogi- 
caliy representative of the classroom ehvirbnmeht. Another 
reason concerns the researchers' purposes for conducting the 
studies i Most i^ere designed tb test theories of learning and 
comprehend ihg which were prevalent at the time. For example, 
during the behavioral era^ the emphasis was on using questions 
to program and control student learning. These studies 
generally focused oh manipulating certain variables such as 
question mbde^ question position and frequency of placement on 
the reteht^h of ihtehtibnal and incidental .materials. Thus^ 
this experimental apprbach has been termed a "variables orienta- 
tion** to ihterspeA.sed question research (Rickards and benner, 
1978, Pi 313} i In contrast* during the cognitive era, the 
focus was oh varying -the depth of processing^ (Craik and fcbck- 
hart, 1972/ p^ 675) requir^ to answer the question. Through 
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this manipuiatidn of question level, researchers have been 
able to make inferences regarding the processing characterise* 
tics effected by interspersing questions in text, fts such, 
this approach has been termed a ""process orientation" (Rickards 
and benner, 1978, p. 3l3) • Examining this issue from another 
pe^rspective, that of the classroom practitioner, little is 
known about the effect questions may have on "slicing*" or 
reducing the amount of print students encounter while reading 
their textbooks. 

The concept of "slicing" was first described by Pearson^ 
and Johnson (1978) in conjunction with question-asking and later 
expanded by Readence and Moore (1980) as a means of re-examining 
the tasks required in reading text assignments and recasting 
them to match the abilities of the readers, ftt the sentence 
level, slicing can be accomplished by chunking the material into 
thought units to facilitate understanding (Carver, 1970) . ftt 
the paragraph lev6l, slicing is Accomplished by interspersing 
qut^stions in text to reduce the amount of print students must 

deal with at a give n ti me^ 

To draw any conclusions from existing research about the 
benefits of using interspersed questions to "slice the task" 
would be difficult since, despite the recent influence of cogni- 
tive psychology, the interspersed question paradigm itself has 
remained much as it was in the sixties. Typically, one or two 
questions are inserted in a passage specially constructed to 
control for segment length and topical organization. The 
instructions stipulate that readers are not to turn back to a 

4 



Interspersed Questioni - 3 
page once it has been turned, nor to take any notes while read^ 
ing (e.g., Hadgins, et al., 1979; Reynolds, Standiford, s 
Anderson, i979; Rickards fi Hatcher, 1978) • Most frequently; 
college students have been employed as subjects in these studies 
(e.g., ftndre et al., 1980; Boyd, 1974; Hlller, 1974? Koran i 
Koran, 1975; Rickards, 1976; Shavelson, Berliner, Ravitch fi 
toeding, 1974) . , 

An obvious problem exists in the present studies in that 
they still possess the rudiments o£ programmed instruction. 
Alternating a page o£ text with a page containing a question is 
not a common classroom practice. In fact, it Is difficult to 
determine if subjects actually attend to questions interspersed 
throughout the text^ or, since ofjush ho overt response is 
required, if they instead tend to ignore the question entirely. 
Further, since no review of the text is permitted, the results 
of these studies are hardly geheralizable to classroom situa^ 
tidns which ordinarily permit review. 

This artificiality of experimehtatibh has been highly 
criticized in many reviews of the research oh ihterspersed 
questions (Durkin, 1981; MacOonald-Rdss, 1978 ; Rickards, 1979 ; 
Rickards S Denner, 1978) . For example, Durkih's (l98l) 
analysis of the literature idehtified several limitations and 
flaws which hinder the classroom applicability of the results 
of this research; First, she questioned the geheralizability 
of the results to all students ih that the subjects used were 
predominantly adults^ most often easily accessible college 
students. Second^ she doubted the general applicability of the 
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Interspersed Questions * 4 
research to other types of school material since most typically 
the material used Was excerpted from psychblbgy textbooks. 
Thirds she dehbuhced the researchers fbr failing to describe 
adequately their methbdblbgy. 

Durkih recbmmehded that the researchers brbadeh their scbpe 
by investigating the effects of questions on students of ail 
ages^ abilities^ ihtelligehce and socibecbhbmie backgrounds. 
She emphasized the heed to cbhduct the experiments in classrobm 
settings using actual school material and hbhliteral level 
questibns. Ahd^ in ah effort tb add a hew perspective tb the 
current research^ she suggested that researchers in other 
disciplines^ such as reading education^ should become involved 
in the experimehtatioh in cognitive psychology* It is tb these 
needs that the present study was directed. 

Methbd 

Subjecte 

The subjects for this study consisted of 103 seventh grade 
students attending ah urban school in the Southeast. The 
students were identified as either good or poor readers using 
scores oh the California ftchievemeht Test C1977) • Poor readers 
were defined as those students whose total reading grade equiva- 
lent scores fell between 4.S and 6.4 grade levels* Good readers 
were defined as those students whose total reading grade equiva- 
lent scores fell between 7i6 and 10.0 grade levels. The sub- 
jects participating in the study consisted of 18 males and 24 
females who met the definition of a good reader and 30 males 
and ?\ females who met the definition of a poor reader. 
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gxperlmehtal Hateriais 

Eassaqes i All subjects were required to read four cbhteht 
area passages. The passages, from a population of passages 
originally used in a study by Memory (1979), Were randomly 
selected from six basal readers, six science _ texts, and six 
social studies texts bh the Georgia State -Approved Textbook 
Listi They were chosen because none exceeded the seventh grade 
level as deterinihed by the bale-Chall Readability Formula {1948) 

Interspersed Questions . In this study, questions were 
placed after each text segment deemed conceptually significant 
and of appropriate length. This was done to approximate the 
manner in which a classroom teacher would determine question 
placement. The questions interspersed throughout the text 
passages were "meaningful learning postquestions, " that is, 
"questions which require readers to organize paragraph details 
under the major concepts in the text segments* {Rickards and 
flatcher, 1979, p- 543) . 

criterion Tests . Folldwing the reading of each passage, 
subjects took a multiple-Choice test to assess their corapre- 
heniibn. Two weeks later, subjects retook each multiple-choice 
test to determine the effects of the treatments bh long term 
retention. In order to include a broader sampling bf COtttpre- 
hensibn tasks, the tests consisted both textUally explicit 
items which elicit ihfbrmation explicitly stated in the test 
and textualty implicit items which elicit infbrmatibh not 
directly stated or implied in the text (Pearson and Johhsbn, 
i978) . 
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J udgments of Validity 

A panel of judges was enlisted to determine the appropri- 
ateness of the following: i) the content, placement and clarity 
of the questions interspersed in the text, and 2) the content 
and clarity of the sultiple-^choice items. The panel was composed 
of three~^bctorai students in reading education, all of whom 
were former seventh grade teachers. Items were accepted when 
two of the three judges reached agreement on their appropriate^ 
nesi^. 

Experimental Treatments 

The experimental treatment conditidns utilized in this 
study were as follows: 

Treatment One (T^) - No Questions (NQ) . Subjects Assigned 
to this group read text which contained no experimental questions. 

treatment Two (T^) - Questions - No Review iom) . Subjects 
assigned to this group read text containing the i^nterspersed 
pbstquestiohs and instructions not to look back in the passage 
segment. There was one segment of text per page with the sub- 
sequent page containing only the postquestion. This treatment 
involved the experimental conditions most common to the inter- 
spersed question research to date. 

Treatment three (t^) - C3uestion - Review (QR) . Subjects 

^ ■ — : — - I 

assigned to this group received the interspersed postquestions 

and instructions to look back in the passage segment for their 
response; Each page contained one segment of text and one post- 
question, the page format described was intended to facilitate 
the review prd^ess. 
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Treatment Pour If^) - Questions - Review Write TORW} ^ 
Subjects assigned to this group read text eohtaihihg the ihter-^ 
spersed postguestiohs^ ins true tibhs to iook back in the passage 
segment and iitstructibns to ^ite their responses on paper. 
Saving the subjects write their responses was intended to force 
their attention to the questions in the texti One segment of 
text and one pbstquestion appeared on each page in addition to 
three lines on which to write the responses. Specifying the 
number of lines was designed to cue the reader to the length of 
response. 

For ^ach passage, four - sets of booklets were constructed 
in the manner of the four treatment conditions* Specific 
instructions regarding the treatment were given on the front 
cover of the booklet. With the exception of Treatment Four CQRW) 
which required a written response, students were instructed not 
to write in the booklet. I 
Design 

A 2 X 4 X 2 ANOVft with a repeated measure oh the third 
factor was utilized in this study i The factor levels included 
achievement level (good and pbpr readers}, treatment (the four 
conditions) and retention (short term and long term) . 

Using a tatih-square design, subjects were randomly assigned 
to one of four treatment arrangements (See Figure 1) . This was 
done for three reasons: 1) to block any effects of treatment 
sequence; 2) to ensure that each subject ehcbuhtered all four 
of the treatment conditions one time and 3) to block the effects 
of passage condition. 



Description of the Four Treatment Arrangements 
to vniich Subjects Were Randomly Assigned 
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Figure 1 about here 



Procedures . . i 

The data for this study were e63.ieeted in intact diassrooms 
of 27 to 31 subjects* The data cbllectioh period for short term 
retention lasted six school days and the data collection period 
for Ibnf term retention lasted two school days. The researcher 
and two aides took ovet the classes for the duration of the 
study. Students wjere told that they were the participants in 
ail attempt to findjout the besst way for them to gain information 
from their textbooks. 

after introducing the pttrpose of the study, ail subjects 

- - ■ - - _ \ _ _ ■■_ _ \ 

participated in a modeling activity designed to thoroughly 

acquaint them with the reading tasks and provide a hatuf^ 

• - - - - - \ ' ^' ^ _\__ 

trahsitidh during the actual experiments' Two weeks after the 
initial data colleel^ioh period, the researcher returned to 
destermihe the effects of the treatments on long term retention. 

Results 

Ta|3le 1 presents the descriptive data for the investiga- 
tion. Specifically^ it shows the means and standard deviations 
for the two groups {good and poor readers) and for the four 
treatment conditions (NQ, QNR, QR, QRW) on both short term and 

V 

long term retehtibh. 
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^ Table 1 

Sunaary of Cell Means- and Standard Deviations for Good and Poor Readers on 

Short, Tertii aiid Long Terni Retention 



Good Readers Poor Readers 



5 S.D. 1 • S.Di 



Short Jen TST) Total (ST) M ■ 5.73 ; 

5.88 2.13 4.n 2.50. 

^ 6.75 1.89 4.57 2.11 

^'Q? ^ 2.08- V 4.59 m 

QS» '7.79 . m • i ,4.77 , 1.9J 

Long Terra (LTj • Total (LT) H » 4 .98 

■ 5.38 2.17 3.51 1.72 

^'99 ^ 2,11 4.67 .'1.99 

^ S»26 2.37 3.98 ' ' 1.77 

6.50 2.29 4.15 ^ 1.92 



Total I 6.45 . g 4»26 
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The results of the 2x4x2 ANOVA displaced in Table 2 * 
reveal statistically significant main effects for the three 
factors (achievement levels treatment and retention) manipulated 
in the experiments The data revealed no significant inter- 
actions among these factors* With respect to achievement level, 
therd was a statistically significant main effect, 
PCl^iei) » 94^34, p<.05, with the retention scores of the good 

readers {M » 6.45}. exceeding the scores of the poor readers 

_ _ ■ • \^ - _ _ _ 

{a = 4.26) i With respect to retehtibri^ there was a statistically 

significant main effect, FU,101) = 62.48, p^.05, with better 

scores 'on short term retention (M » 5,7 3) than oh long term 

retention {M ^ 4^98), 

Tabled also shows a significant main effect for the 

treatment conditions across the two achievement levels 

PC3^303) ^ 7.04^ P4. .05. Scheff^'s multiple comparison test 

was used to determine the means between which significant 

differences existed. The results indicated that the mean for 

the QRW treatment IH = 11 .11) was significantly higher than the 

mean for the NQ treatment IR 9.28) with no other significant 

differences between the treatment conditions. 



Table 2 about here 

ftcfiievem^nc ^ 

There was a significant difference, F{3,39) « 7.88; p<.b5, 
between the retention scores of the good readers experiencing 
the various treatment conditions indicating that the treatments 
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Summary of the Repeated Heasures Analysis of Variance for Good and Poor Readers 
on Short Term and Long Term Retention (Considered Together) 



1 

/ 

Source of Variance 




U-»-ir» 


Mean Scruarfi 


p 


Achievement 
Errorj^ 


962.41 


lUJL 


962.41 : 

iO 20 


94^34 


Treatment * ' 
Treatment x Achievement 

Error2 


104.93 
28.08 
1504.57 


303 


39.98 
9.36 
4.97 


7.04 

ii89 


Retention 

Retention x Achievement 
Error^ 


111.80 
1.60 
180.71 


101 


111.80 
1.60 
1.79 


62.48 
0.90. 


Treatment x Retention 

Treatment x Retention x Achievanent 

Error^ 


2.94 
7.18 
595.64 


303 


0.98 
2.39 
1.97 


1.22 

mmm 
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Interspersed Questions tO 
had a significant effect on good readers' short term retention. 
The resuits of the Scheffe test revealed that the mean (M - 7.79) 
for treatment group QRW was significantly higher (p< .05) than 
the mean (H » 5.38} for treatment group NQ with no other 
differences reaching significance* However, with respect to the 
poor readers under study the treatments had no significant effect* 



In all instances where significant differences were obtained 
among the treatment conditions, the Scheffe multiple comparison 
test indicated that the Q^W (questions - review - write) treat- ' 
ment was superior to the NQ or control treatment (no questions in 
text) • No significant differences were found ifetween the scores 
for the other treatment conditions (e.g., QR, questions - 
review and QNR# questions no review) • 

The treatment conditions had a statistically significant 
effect on subjects* short term retention* F^(3,lbb) => 4.88, p^.OS. 
Again, the Scheffe" test indicated the mean (H » 6.bb) for the 
QRW treatment was significantly higher (p<.b5) than the mean 
(H ^ 5.bl) for the NC2 group with no other differences showing 
significance. No significant differences were found for the 
poor readers on short term retention F(3,58) =* b.374, p « .77. 

While there were statistically significant differences 
between the long term retention scores of the subjects experi** 
encing the various treatment cond4rtions, the results of the 
Scheffe test failed to show significant differences. A similar 
pattern was obtained for both the scores of the good readers. 
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P(3,39) ■ 2.40^ p - .07, and the scores of the poor readers^ 

_ - ■ _ _ ■ \ 

P(3,58) - 1.63, p « .18, on the variable o£ Ion? term retention 



The findings will be discussed in conjunction with the 
research questions which have formed the basis for this investi-* 
fation* 

Will interspersing questions in text enhance learning of 
actual content area material ? 

The present investigation has used passages excerpted from 
actual content area textbooks. Since positive effects have been 
noted for interspersed question treatment QRW# it appears that 
^interspersing questions in text, at least in the manner of treat- 
ineht QRW^ can enhance the learning of content area textbook 
material. 

Most of the studies to date have, employed contrived text 
developed to cbhtrbi for segment length and topical organiza-* 
tibh (e.g.^ Frase^ 1968; Hudgins et al., 1979; Rickards, 1976) i 
Yet, a need has existed to determine if the use of adjunct post- 
questions is effective with cla^ssroom material (burkin, 1981; 
MacDbnaid-Rdss, 1978; Rickards & Denner, 1978). Not only were 
th^ passages used in the present study derived from actual text- 
bbbks^ but aisb the determination of question placement was based 
on the judgments of former junior high teachers. In previous 
studies (e.g.^ Hudgins et al., 1979; Rickards biVesta, 1974) 
questibh placement^ was determined by passage and segment lengths 
Cbhsequehtly^ this study has provided evidence for the efficacy 
of interspersed questibhs using materials which were ecologically 
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Interspersed Qttestiohs - 12 
representative of the classroom exrviroxment ^ 

Will allowing students to review (look b a ck i n) tfie text 
facilitate cbmprehehsibn? 

The fihdiilfs indicated that statistically significant 
differences existed between the control group and the questibns- 
review-wri^e group. No other significant differences were found 
between the 1 remaining -iireatment group scores (questions-no review 
and questions-review) . Therefore, it is not known if the effect 
resulted from fOrcirg subjects' attention to the question through 
writing or if it was from the combined effect of wfiting with 
permission to review the text. Ah additional study c^uld assess 
effects of a questibh-ho review-write treatment in order to 
determine if review in cbmbinatibn with writing is^ the mbre 
effective treatment. Since no significant effects were nbted 
for the quest ibh-review treatment, apparently just permitting 
students to review the text is not sufficient to enhance com- 
prehehsibh; 

Will having students write th eir resp onse^ to ensure 
atte ntibn to the question, enhance compr eh e n s i on? 

in all instances where significant differences were hbted 
between the scbres bf the subgects experiencing the various 
treatment cbhditibhs, the QRV? treatment produced higher reten- 
tibh scbres than did the cbntrbi treatment. These findings were 
evidenced for ail subjects (good and poor readers considered 
together) bn two bf the three dependent variables (short term 
retentibh and short term and long term Retention combined) . ♦ 
Treatment QRW was effective only for>good readers and only on 

; : ■ ■ • ■ .: . . ■' ■ ^ 
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Interspersed Questions • 13 
short term retehtidh and short term and long term retention 
combined b Since no significant differences were noted between 
the scores of subjects ^receiving either the question-no-review 
or the questions-review treatment, it appears that forcing 
attention to interspersed questions through writing is an effec 
tive method for improving comprehension* Most frequently in 
previous studies subjects were expected to make a covert mental 
response to the question (e.g., Rickards, 1976; Rickards ^ 
Hatcher, 1^78; Rowls, 1974; Wilson, 1979). In the instances 
where an overt response was required, subjects were asked to 
identify a correct answer or fill in the blank with a word or 
phrase {e.g., Andre et al., 1980; Sagaria S DiVesta, 1978; 

Watts & Anderson, 1971) . However, such procedures during read- 

_ ■ ■ ^ 

ihg are not common in a classroom situation. 

Will go od re aders or poor readers receive the greater 

The results indicated that interspersing questions in text 
in the manner of treatment QRW is effective for good readers on 
short term retention and on short term and long term retention 
considered together. No significant differences appeared for 
poor t-eaders experiencing the various treatment conditions. 

A possible explanation for these findiugs with respect to 
good and poor readers concerns the interaction between the 
achievement level of the subjects and the readability level of 
the experimental materials. Since good readers were defined as 
scoring between 7.6 and 10 iO on the gaiifornia AGhtevement^Test 
and since scores on standardized tests often represent t!ie 
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frustration reading level, it is likeiy that the seventh grade 
passages were at their instructional reading level. Therefore, 
with assistance in the form of questions interspersed in the 
text, good readers* comprehension was significantly enhanced. 

Conversely, the poor readers, defined as scoring between 
4/6 and 6.4 on the California Achievement Test ^ were experiehc-^ 
ing material on their frustration reading level. As a result, 
even with the insertion of questions in text to reduce the 
amount of print encountered at one time* the readability level 
of the materials proved to be too difficult. These findings 
are at variance with the findings of Rickards and Hatcher C1978) 
who reported that meaningfiii iearhihg pbstquestions, presented 
in the manner of treatment SNR, improved the cbmprehehsibn of 
poor readers . They also reported that- adjunct questions may be 
superfluous for good readers. 

Numerous methoddidgicai differences exist between the 
Rickards and Hatcher study and the present investigation which 
may explain the disparity in findings between the two studies. 
A possible explanation centers around the definitions of arid 
criteria used to differentiate between the good and poor readers 
under study. Rickards and Hatcher (1978), using 93 fifth graders 
as subjects, defined good readers as reading at or up to two 
years above grade level on the N^w Developmental Reading Test . 

Poor readers were defined as those subjects reading at least one 

_ _ . _ ■ - _ _ _ _ _ ' ' 

year below grade level on the saihe test. Eliminated from cbn^ 

■/' ■ 

sideratibh were thbse poor readers who scored at or below the 
^ third stanihe on the word analysis sectibh of the Stahfbrd 

■ . ■ ■ ■ ■ ■ . ' : 

o ■ ^' 
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interspersed Siiestibhs - 15 
Dt aqnostic Readi ng^gtest . In the present study» seventh grade 
subjects reading between 6.5 and 7.5 grade levels were eliminated 
from consideration to maximize the differences between the two 
ability groups. Also eliminated from the data analysis were 
sttbjects whose reading grade equivalent scores fell below 4.6* 
It may be that the poor readers used in the Rickards and Hatcher 
study were superior ixi terms of reading ability to the poor 
r eiders used in this investigation which may account for the fa^ci, 
that they were, able to comprehend a grade level passage which 
contained interspersed postquestidns • | 

What ef fect will interspersing questions have on students ' 
long term retention ? 

The post hoc analysis revealed ho significant differences 
between the delayed retention scores of subjects experiencing 
the four treatment conditions. Consequently^ it appears that 
interspersing questions in text does hot significantly enhance 
students* long term retention scores. It may be that retaking 
all four tests during the same class period interfered with 
subjects' recall of the information. However^ th^ data do hp t 
support the use of adjunct pbstquestibhs as aids for long term 
recall, ^ 

W^at effect will interspersed questions have oh school age 
subjects' comprehension of textbook material? 

In this study^ positive results have been found for seventh 
grade subjects (defined as good readers) on tiie QRW treatment* 
Thus, it appears that interspersing questions in textbook 
material, in the manner of the QRW treatment^ has a facilitative 
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effect on schbdl age subfjects* comprehension* As indicated 
' earlier^ many of the studies oh adjunct questions were conducted 
in a laboratory setting using college students who were either 
required to serve as subjects or who were paid to serve as i^wb- 
jects (e.gw Andre et al.^ 1980; Bdyd^ 1974; Rickards, 1976; 
Rbthkbpf ^ 1965} » Other researchers (MacDbhald-^Rdss^ 1978; 
Rickards/ 1970; Rickards & Dehher^ 1978; Durkih^ 1981} have 
criticized this practice and have questibhed the applicability 
bf the findings tb actual classroom settings. The present 
investigation has prbvided evidence to support the use of a QRW 
treatment with seventh grade subjects reading above grade level. 

Implications and Cone Itjs ions 
It has been suggested that empirical evidence is needed 

i 

tb validate many bf the secondary reading strategies purported* 
tb facilitate cbraprehehsibh (Patberg, 1979) • The present investi- 
gatibh has attempted tb provide evidence to either confirm or 
refute the use bf interspersed questibi^ in text. Since signifi- 
cant effects favoring a question-review-write (QRW) treatment has 
been demonstrated, it appears that questions inserted in text may 
be ah effective instructional method, at least for some s€ud^nts« 
* The need to •'slice the taslc," e.g., redttce the amount bf 

print a student miist deal with at a given time, by tssing questions 
inserted in text has been advocated by teacher educators (Read- 
ence s Kobre, 1980) • The present study has shoWn that this may 
be' an effective instructibnal strategy for good readers (subjects 
reading above grade level) but not for poor readers (subjects 
reading below grade level) when the task also involved -writing 
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answers to tbe questions. Apparently^ despite the use of inter- 
sperse<f questions as aids^ poor readers still have difficulty 
comprehending content area textbook passages written on grade 
ievai. 

Therefore^ the findings of this investigation suggest that 
teachers must use adjunct aids in the form of interspersed 
questions very selectively. Due to the concept density, of most 
content area textbook material even good readers seem to heed 
textbook modification techniques such as the QRW treatment. It 
cannot be assumed > however^ that poor readers are receiving 
benefit from textbook material cbhtaihihg interspersed ouestibhs. 
Instead, poor readers may need alternative material written on 
an easier level in order to understand content area concepts. 
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